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1.  Introduction 

In  recent  years  linear  programming  has  become  an  enormously  important  and 
widely  used  tool  for  solving  a  variety  of  problems  encountered  in  the  practice 
of  operations  research.  The  original  Simplex  method  (which  we  henceforth  refer 
to  as  the  ordinary  method)  as  presented  by  Dantzig  [2]  is  a  robust  algorithm 
which  comprises  the  basic  architecture  of  many  commonly  used  linear  program¬ 
ming  codes.  For  other  early  contributions,  see  Chames  [1]  and  Dantzig, Orden 
and  Wolfe  [3].  Prominent  empirical  studies,  authored  by  Wolfe  and  Cutler  [6], 
and  Kuhn  and  Quandt  [4],  have  compared  and  reported  upon  certain  variants  of 
the  ordinary  method.  These  reported  results  concern  the  effects  of  alternative 
rules  for  such  features  as  choice  of  the  pivot  element,  choice  of  the  form  of 
the  inverse,  choice  of  the  phase  1  procedure,  etc.  An  advanced  exposition  of 
various  extensions  appears  in  Orchard-Hays  [5]. 

At  the  present  time,  though  the  ordinary  Simplex  method  is  considerabl .* 
efficient,  it  is  nevertheless  true  that  efforts  to  solve  large  problems  are 
typically  expensive,  and  new  frontiers  in  linear  programming  can  be  identified 
with  attempts  to  hasten  convergence  to  optimal  solutions  of  such  problems.  In 

1  Department  of  Statistics  and  Curriculum  in  Operations  Research  and  Systems 
Analysis,  University  of  North  Carolina  at  Chapel  Hill.  This  work  was  sponsored 
in  part  by  the  Office  of  Naval  Research,  Contract  No.  N00014-67-A-0321-0003. 
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this  paper  we  explore  a  particular  approach  to  achieving  greater  efficiency  for 
large  scale  problems.  In  particular,  a  new  variant  of  the  ordinary  Simplex 
method  is  proposed  as  a  possible  algorithm  for  solving  a  newly  defined  class 
of  large  inexact  problems. 

A?  a  starting  point,  we  note  that  in  linear  programming  applications  it  is 
not  highly  unusual  for  the  aata  of  the  problem  to  be  inexact.  There  are  many 
causes  for  imprecision  of  data.  Some  classes  of  real  world  problems  in  fact 
appear  to  be  impervious  to  the  analyst's  most  ponderous  efforts  to  cast  them 
into  a  precise  optimization  model.  Such  problems  often  represent  large  scale 
decision  models  of  systems  with  a  highly  diffuse  and  even  tentative  or  specu¬ 
lative  structure.  The  purpose  of  the  model  is  frequently  to  enable  a  decision 
maker  to  gain  insight  for  purposes  of  gross  planning,  explore  tradeoffs,  and 
merely  improve  rather  than  gain  optimality.  The  very  notion  of  sharp  optimi¬ 
zation  may  be  a  matter  of  forensics  -  at  least  within  the  limits  on  the  pre¬ 
cision  of  the  data.  Linear  programs  of  this  nature  might  descriptively  be 
dubbed  as  "proximate  linear  programs".  In  spite  of  this  special  quality  of 
imprecision  in  many  of  our  models,  and  in  spite  of  its  inevitable  accentuation 
with  the  growing  interest  in  social  and  urban  problems,  the  prepotency  of  the 
engineering  disciplines  has  continued  to  almost  completely  shape  the  mode  of 
inquiry  in  rigorous  operations  research.  Looking  at  a  special  class  of  large 
scale  imprecise  problems  -  linear  programs  with  tolerances  in  some  of  the 
data  -  it  is  the  objective  of  this  study  to  attempt  to  develop  an  algorithm 
which  might  intelligently  recognize  and  exploit  the  special  structure  afforded 
by  inexact  data.  In  short,  it  was  hoped  that  an  algorithm  could  be  developed 
which  would  tend  to  be  more  efficient  than  the  ordinary  Simplex  method  when 
the  problem  data  are  inexact,  and  which  would  reduce  to  the  ordinary  method 
when  the  data  are  precise. 
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To  define  the  goal  more  explicitly,  assume  that  the  right  hand  sides  of 
the  given  problem  are  known  only  within  certain  user  specified  tolerances.  Let 
e  be  a  vector  and  let  the  implied  right  hand  side  windows  be  denoted  by 
b  ±  c.  All  other  problem  data  are  assumed  to  be  exact.  Our  goal,  then,  is  to 
develop  an  efficient  algorithm  for  solving  the  proximate  problem:  find  a  non¬ 
negative  x*  such  that,  for  some  b  in  the  rectangle  [S-e,  S+e], 

(i)  Ax*  S  b,  and 

(ii)  cTx*  a  cTx  for  every  nonnegative  x  such  that  Ax  s  b. 

It  has  been  our  experience  that  optimization  theorists  tend  to  have  dif¬ 
ficulty  in  catching  the  unfamiliar  flavor  of  this  problem.  Analysts  have  an 
irresistable  tendency  to  be  greedy,  and  the  typically  encountered  question  is, 
"Why  not  use  the  right  hand  side  o  +  e  and  get  the  maximum  possible  return?" 

The  point  here  is  that  in  the  ground  rules  for  the  model  under  consideration 
the  right  hand  side  is  not  a  policy  variable  under  the  analyst's  control.  It 
is  an  exogenous  "fuzzy'1  parameter,  and  the  value  E  +  e  is  no  more  worthy  of 
consideration  than  any  other  value  in  the  rectangle  [b-e,  ’  f-e],  Consequently, 
we  propose  an  effort  which  capitalizes  upon  ignorance.  We  wish  to  solve  the 
linear  program  with  the  assumption  of  some  underlying  b  e  [b-t,  E+e],  with 
indifference  as  to  which  one,  with  an  algorithm  which  hopefully  can  economize 
on  consumption  of  computer  time.'*'  The  algorithm  proposed  in  this  paper  is 
heavy  handed  in  the  sense  that  it  relies  upon  well  known  ideas.  It  is  a  modi¬ 
fication  of  the  ordinary  Simplex  method  which  reduces  to  the  latter  when  all 


There  may  be  other  immediate  applications  for  such  an  algorithm  as 
opposed  to  direct  attack  of  an  imprecise  problem.  For  example,  suppose  the 
ultimate  objective  of  a  study  is  to  do  a  sensitivity  analysis  over  a  range  of 
right  hand  sides.  The  proposed  algorithm  could  generate  a  fast  optimal 
solution  for  some  right  twnd  side  in  the  range.  Post  optimality  analyses  can 
then  be  done.  See  the  appendix  for  other  possible  applications. 
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tolerances  are  zero  (i.e.,  when  the  right  hand  side  data  are  exact).  It  is 
not  possible  at  this  writing  to  state  whether  or  not  the  objective  of  increased 
efficiency  has  been  realized  with  any  generality  over  many  classes  of  pro¬ 
grams.  Initial  computational  results  indicate 

(i)  the  method  appears  to  differ  insignificantly  (in  terms  of  compu¬ 
tation  time)  from  the  ordinary  Simplex  method  for  A  matrices  of  size 
25  x  25,  with  tolerances  up  to  ±30%. 

(ii)  With  A  matrices  of  size  100  x  100,  200  x  150  and  100  x  200, 

when  the  Simplex  method  is  applied  to  Ax  S  b,  and  when  the  modified  method 
is  applied  to  Ax  $  b,  b-e  <  b  ^  bte,  there  are  obvious  differences  in  compu¬ 
tation  time.  With  tolerances  (e)  of  roughly  30%  the  modified  method 
appears  to  reach  optimality  in  30  to  70  per  cent  of  the  amount  of  time  taken 
by  the  ordinary  method,  the  realized  reductions  being  dependent  upon  the 
sparsity  and  the  percentage  of  negative  coefficients  in  A.  In  this  case, 
objective  values  between  Simplex  optimality  and  modified  optimality  tend  to 
differ  relatively  by  average  amounts  of  2  to  10  per  cent. 

These  results  and  others  are  presented  in  detail  in  the  final  section  of 
the  paper.  It  will  be  obvious  that  the  modified  method  requires,  on  the 
average,  far  fewer  pivots  than  the  ordinary  Simplex  algorithm.  However,  each 
pivot  requires  more  work.  It  tentatively  appears  that  performance  of  the  me¬ 
thod  improves  with  problem  size,  is  better  for  positive  A  matrices,  and  is 
not  helped  by  sparseness.  It  should  be  stated  that  while  our  computational 
experience  is  at  present  far  too  limited  to  draw  any  conclusions,  there  would 
seem  to  be  adequate  justification  for  further  empirical  inquiry  into  the  use¬ 
fulness  of  the  modified  method,  expecially  as  regards  the  performance  on 
large  problems.  Also,  theoretic  possibilities  exist  for  allowing  tolerances 
in  the  other  data  of  the  problem,  for  improving  phase  1,  for  further  improving 
or  modifying  the  proposed  technique  for  tolerances  in  the  right  hand  sides 
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(e.g.,  building  in  a  procedure  for  equality  constraints),  and  for  applying  the 
proposed  technique  to  other  contexts.  Several  such  applications  are  discussed 
in  the  appendix  to  this  paper. 

It  may  be  helpful  at  the  outset  to  make  a  rough  descriptive  comparison 
between  the  method  to  be  advanced  end  the  ordinary  Simplex  method.  Consider 
the  polytope  given  by  Ax  <  b^,  x  2  0,  and  the  larger  containing  polytope 
given  by  Ax  ^  b^,  x  2  0.  These  two  polytopes  define  the  proximate  problem 
of  interest.  In  oir  context,  given  a  mean  for  the  right  hand  side  interval, 
say  b,  and  given  a  vector  of  tolerances,  say  e,  we  shall  have 

=  E-e  S  b  5  B+e  =  ’  We  begin  with  a  phase  1,  if  necessary,  on  the  poly¬ 

tope  Ax  S  b^,  x  >-  0,  in  order  to  find  an  initial  extreme  point,  say  E^. 
Beginning  at  E^,  the  ordinary  Simplex  method  xrould  change  basis  by  ex¬ 
changing  2  columns.  The  column  to  be  entered  distinguishes  an  edge.  The 
column  to  be  removed  is  chosen  in  such  a  way  that,  speaking  geometrically, 
there  is  a  motion  along  the  distinguished  edge  from  E^  to  an  adjacent  ex¬ 
treme  point  E^.  In  the  modified  method  one  will  also  change  basis  by  ex¬ 
changing  2  columns.  The  column  to  be  entered  is  chosen  as  in  the  ordinary 
Simplex  method,  thus  distinguishing  the  same  edge.  (A  criterion  other  than 
the  ordinary  entry  criterion  could  be  used.)  However,  the  remove  column  is 
not  necessarily  chosen  so  as  to  step  to  an  adjacent  extreme  point.  Rather,  it 
is  chosen  according  to  the  criterion:  Take  as  large  a  step  (along  the  dis¬ 
tinguished  edge)  as  possible  to  a  new  basic  solution  with  the  following 
properties 

(1)  the  activities  x^ ,  j  =  l,...,n  must  remain  nonnegative 

(ii)  the  new  solution  may  be  infeasible  with  respect  to  any  subset  of  the 
right  hand  sides  bp,  but  not  with  respect  to  any  of  the  right  hand 
sides  t>2i’  that  is,  the  new  solution  may  violate  some  of  the  con¬ 
straints  with  right  hand  side  bll*  and  hence  lie  outside  the  poly¬ 
tope  Ax  <  b^,  x  5  0,  but  it  must  not  be  outside  the  polytope 
Ax  s  b2,  x  2  0. 
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(In  general,  such  a  basic  solution  will  lie  past  the  extreme  point  adjacent  to 
Eq.  Consequently,  we  achieve  greater  increase  in  the  objective  function.)  At 
this  new  basic  solution,  the  violated  b^  right  hand  sides  are  translated  to 
t>2^  values.  We  then  are  at  an  extreme  point,  say  £,  of  the  polytope 

m 


l 

j-1 


a .  . 
ij 


'li» 


i  e 


W 


1 


m 


l 

j-1 


a .  . 


<  b 


2i  ’ 


i  e  N2 


x  >  0 


where  indexes  the  constraints  which  have  been  assigned  the  new  right  hand 

A 

side  value  b,,^.  Beginning,  then,  from  E,  the  same  method  is  repeated  to 

A 

obtain  a  new  point  §  which  will  be  an  extreme  point  of  some  (possibly  new) 
poly tope.  At  each  extreme  point  the  sets  and  N2  are  updated  as  re¬ 

quired.  Initially,  at  point  EQ,  in  the  case  where  all  constraints  have  tol¬ 
erances,  the  set  indexes  all  the  constraints  and  N2  is  empty.  (The 

procedure,  however,  will  allow  some  of  the  constraints  to  be  exact.  If  they 
are  all  exact,  the  method  reduces  to  the  ordinary  Simplex  method.)  As  the  al¬ 
gorithm  repeats,  the  indices  tend  to  transfer  from  the  set  to  the  set 

N^.  At  some  stages  the  sets  ni3y  remain  th^  same.  Computational  experience 
indicate?  that  large  transfers  from  to  N2  tend  to  occur  early  in  the 

game  as  opposed  to  later.  Also,  as  expected,  larger  tolerances  encourage 
larger  transfers  and  better  performance  for  the  modified  method.  Figure  2 
provides  a  sketch  of  the  geometry  of  the  new  method. 


7 


2.  Notation 

Let  A  be  an  n  x  n  matrix  with  columns  P. ,  P_,  ....  P  .  Let  b  be 

1  L  n 

i  n 

n  K  ’  c  tn  R  ,  and  let  c  denote  a  given  nonnegative  m-vector  of  toler¬ 
ances  (for  example,  the  components  of  e  may  be  given  by  =  .205,^).  The 
problem  to  be  solved  is 

P:  find  nonnegative  x*  e  Rn  such  that  for  some  b  e  [b-e,  Etc] 

(i)  Ax*  s'  b,  and 

(ii)  cTx*  >  cTx  for  every  x  >  0  such  that  Ax  £  b. 


Any  such  x*  will  be  called  an  optimal  solution  to  P. 

Let  X  =  {l,2,...,n}  denote  the  indices  of  the  activities  and  let 
S  =  \n+l, . . . ,n+m}  be  the  set  of  slack  indices.  Let  the  fuzzy  slacks  be  in¬ 
dexed  by  F  =  {ieS:  c.  >0},  and  let  the  exact  slacks  be  indexed  by 

x-n 

E  =  S-F.  Let  b  ^  =  b  —  l ,  b2  =  b  +  e,  and  let  S  be  the  nonnegative 

m-vector  given  by  £  =  b2  -  =  2f  . 

Let  A  denote  the  A  matrix  augmented  in  the  usual  way  with  an  m  x  m 

identity  matrix  and  denote  the  last  m  columns  of  A  as  P  ,  .  A 

'  n+1  n+m 

basis,  say  S,  will  correspond  to  m  columns  of  A,  say  PT  ,  PT  ,  . . . ,  PT  . 

1  2  m 

Corresponding  to  each  basis  S  will  be  a  point  in  R  with  basic  coordinates 

XB  =  ^XI  ,XI  ) •  Xonbasic  coordinates  are  always  assigned  the  value 

12  m 

zero.  Also,  corresponding  to  each  basis,  C,  is  a  tableau  with  rows  indexed 
from  1  to  r  r  I  and  columns  indexed  from  0  to  m  +  n.  The  entries  of 


the  zero  column  of  the  tableau 


j  =  1, .  .  .  ,m;  *rr(_1>0  xg. 


corresponding  to  B  are  defined  by  x,-.  =  x_  , 
The  entries  in  the  remaining  columns,  excluding 


the  last  rev,  are  given  by  the  coefficients 


in  the  expressions 


,  j  =  l,...,u  +  m.  The  last  row  of  the  tableau,  excluding 
of  ti’.e  usual  reduced  costs. 
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In  the  method  to  be  described,  as  in  the  ordinary  Simplex  method,  a 

basis  B  will  be  replaced  with  a  basis  $  by  a  simple  exchange.  That  is, 

some  vector  P^.  (corresponding  to  the  rtb  row)  is  replaced  by  a  vector 

Pg.  Thus,  the  new  basis  is  given  by  P  ,  PA  ,  . . . ,  P^  ,  where  ”  e 

and  i.  =  IJ  for  j  ^  r,  It  will  be  convenient  to  let  I  denote  the  set 
3  3  J 

{I,,..., I  }  of  indices  of  a  current  basis  B,  and  to  let  R.  ,  for  k  £  I, 

denote  the  row  of  the  current  tableau  such  that  x  .  *  x^.  Thus,  v/e  have 

K 

the  notational  relations 


Rj  =  j  (i.e.,  xx  =  *j0),  3  €  (1, . . . ,m) 


\  =  3  <1'e-’  XV‘V’  l€l- 


Finally,  the  sets  and  wiH  denote  "current  partitions"  of  the 

set  S  (i.e.,  Jj^  u  J2  =  S,  Jj  n  *  <j>)  .  The  sense  of  "current  partition" 
will  become  clear  in  the  sequel,  for  we  shall  be  interested  in  problems  of  the 


form 


max  cTx,  subject  to 


n 


(1) 

l  *ij 
3=1  3 

X.  +  x  ,  . 

J  n+i 

=  bu. 

n  +  i  c 

J1 

n 

X,  +  X  . 

3  n-i 

=  b2i* 

n  +  i  e 

CM 

x  > 

0. 
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3.  The  Algorithm 


The  modified  method,  flow  charted  in  Figure  1,  can  be  described  in  9 
steps . 

1.  Initial  Step.  Set  J2  =  E,  =  F.  Do  a  phase  1  on  (1)  to  obtain  an 
initial  feasible  basis  B  and  corresponding  basic  feasible  solution  x. 

GO  TO  2. 

2.  If  all  reduced  costs  are  nonpositive,  TERMINATE.  Otherwise,  choose  an 
enter  column,  e,  as  in  the  ordinary  Simplex  method,  to  be  one  which  has  a 
maximum  reduced  cost.  Define  0^  and  T^  as  follows: 


6  =  min  [x./xR  :  x 

1  Id  J  V  R1 


>  -  VXRte’  C  6  T1 


j  cl  J  “j”  ‘'j 

That  is,  T^  denotes  the  set  of  basic  indices  which  tie  for  the  determination 
of  9^. 

GO  TO  3. 

3.  If  Tj  £  J1>  set  i  =  2  and  GO  TO  4.  Otherwise,  select  an  index 

I  e  T.,  obtain  a  new  basis  $  by  replacing  Pj.  with  Pe>  and  perform  a 
r  1  r 

normal  pivot  operation  on  the  tableau,  including  an  ordinary  transformation 
of  the  values  xjQ>  j  =  l,...,m. 

Then  GO  TO  2. 

4.  Define  0^  and  T^  as  follows: 


0 


i 


min  ,  [xj/xR.e:  XR.e>0] 
l-l  i  1 

jel  -  U  T 

.  p 

P=1 


xt/xRte’ 


t  £  T.. 

l 


That  is,  denotes  the  set  of  basic  indices  which  tie  for  the  determination 

of  &t.  If  Ti  n  J2  n  F  =  <J>  then  GO  TO  5.  Otherwise 


GO  TO  9. 
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5.  If  6.  S  minfO^+tS.  )/x  :  1  £  U1"3  T  ],  then  let  i  «  i  +  1  and 

i  j  ]-n  l^e  J  p»l  p  ’ 

GO  TO  6.  Otherwise, 

GO  TO  9. 

6.  If  T^_^  ii  E  *  ^  GO  TO  7.  Otherwise, 

GO  TO  9. 

7.  If  T1_1  n  X  »  GO  TO  8.  Otherwise, 

GO  TO  9. 

8.  If  U*"*  T  4  I,  GO  TO  4.  Otherwise, 

GO  TO  9. 

9.  Let  9  *»  0.  t  =  x-  /x  -  x  f./x  for  some  I  e  T .  , .  Replace  PT 

i-1  1  re  rO  re  r  i-1  r  X 

r 

with  P  to  obtain  a  new  basis.  The  set  of  new  basic  indices  is 
e 

I  -  {I  }  u  {e}.  Obtain  new  values  of  the  new  asic  variables  from  the 
r 

expressions 


(2)  5. 


A 

xj  ■  9xy’ 

'Xj  '\e+Vn’ 

.  ®. 


j  e  I  ~ 

i-2 

j  e  U 
p=l 


1-2 

U 

p=l 

T 

P 


T 

P 


j  -  e. 


As  always,  the  nonbaslc  are  set  equal  to  zero.  The  new  tableau  values 

x.q,  j  =  l,...,m  are  given  by  x,_  »  x^.  as  determined  from  (2).  Transform 

3  3  j 

the  remainder  of  the  tableau  by  an  ordinary  pivot  operation.  Update  the  sets 
Jj  and  according  to 


J.  -  U  T 
1  P-1  P 


J„  =  J,  u  (  U  T  ). 

/  2  ,  p 

P-l 


GO  TO  2. 
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Remarks  on  the  Algorithm: 


(1)  Note  that  In  step  5  the  subscript  j  -  n  is  positive  since 

Tp)  n  X  ■  $.  This  equality  holds  because  the  only  way  to  enter  step  5 

is  from  step  4  and  the  only  way  to  enter  step  4  is  from  step  3  or  step  8.  The 
route  3  •+■  4  ■+•  5  implies  i  -  2  and  c  j  Hence,  ^  n  X  «  *,  The 

route  8+4+5  implies  i  >  3  and,  from  step  7,  T  n  X  -  *  for  each  j 

such  that  2  s  J  S  i  *  1. 


(ii)  By  convention, 
for  i  >  3,  U1-*  T  c  J, 

latter  assertion  follows 
as  follows.  Suppose  step 
4,  6  and  7  must  have  been 


i-2 

for  i  <  3,  the  set  II  ^  Ip  Is  empty-  In  step  9 
,  but  r.-oed  not  be  a  subset  of  J^.  The 

from  steps  6  and  7.  The  first  assertion  is  argued 
9  is  entered  with  i  =  i^.  Then  the  tests  in  steps 
passed  for  i  «  i  -  2. 
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4.  Optimality  Proof 


Theorem:  After  each  pivot  operation  on  the  tableau,  as  prescribed  either 
in  step  3  or  in  step  9,  the  current  entires  xjg»  3  “  l,...,m,  along  with 
the  current  values  of  and  J ^ ,  represent  a  basic  feasible  solution  to 

(1). 

Proof:  It  is  clear  that  either  in  step  3  or  in  step  9  the  basis  B  is 
replaced  with  a  new  basis  The  old  basic  indices  I  are  replaced  with  the 

indices  $  ■  I  -  {1^}  u  {ei.  We  now  show  that  the  current  entries  are 

feasible,  j  *  l,...,m.  By  definition,  this  requires  a  proof  that  x^  2  0, 

J  e  i.  Since  the  pivot  operation  in  step  3  is  an  ordinary  Simplex  maneuver, 
it  suffices  to  consider  the  values  as  prescribed  in  (2).  From  step  A, 

replacing  i  with  i  -  1, 


From  step  5,  replacing  i  with  i  -  1, 

0  =  01_1  s  j  c  /]. 

Thus 


the  above  remarks,  a  basic  feasible  solution.  We  have 
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nrl-n 


r  A 

j-i  J  J 


K-2  <XJ4xKje)PJ  +  J2  +  8P< 

jcl-  UT  je  U  T 

p»l  p  p*l  P 


Now  let 


I  xjPj  "  ®  I  XR  ePi  +  °Pe 
jd  -1  J  jsl  Rj  j 


+  J2  ek-nPk 

kc  Ul 
P-1P 


I  Yj +  I 

el  J  J  i- 


Jel 


2 

kc  U  T 
P-1  1 


e,  p.  . 

k-n  k 


b  "  ^  x1Pi ' 

jd  J  J 


^  6k-n  Pk‘ 

ke  U  I 
P=1P 


Hence 


[V  n  +  JeJl 


iV  "  +  leJ: 


where  and  J2  are  the  values  of  the  previous  partition.  In  the  expression 

for  b  let  n  +  j  «  k.  Hence 


~  r 

b  “  I 

i-2 

n+j  c  U  T 
P-1  F 


6j  Pn+j’ 


and 


i-2 

6,,  n  +  j  e  U  T 

j  p-1  p 

0,  if  not. 


We  have  therefore  deduced  that 
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^■j-1  *jPj  “  where  ^  *  b  +  b.  That  is. 


ij +  sj  “  V 

n  +  j 

e  n 

i  r 

n  +  j 

£  Jl- 

2j’ 

IT  +  j 

6  V 

fi-2 

.  n  U  T 

1  Ul  pJ 


‘P” 

i-2 

U 

p-1 


From  the  remarks  following  the  algorithm,  ^  T  c  J,  and  therefore  £ 

P=1  P  1 

simplifies  to 


V 

n  +  j 

£  Jl- 

V 

n  +  j 

£  J2  U 

i-2 
U 

p=l 
i-2 
U  T 

lp-1  pJ 


0 


Corollary:  The  algorithm  terminates  in  an  optimal  solution  to  the  problem 
P. 

Proof:  Each  tableau  represents  a  basic  feasible  solution  to  some  problem 
of  the  form  (1) .  Termination  can  only  occur  when  all  reduced  costs  are  non¬ 
negative.  From  ordinary  Simplex  theory,  this  is  an  optimal  tableau  for  the 
problem  of  form  (1)  which  is  currently  represented.  This  implies  that  we  have 
reached  an  optimal  solution  to  problem  P.  D 
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Thus,  point  B  is  a  basic  feasible  solution  to  the  problem 


max  +  c2yi2i  sut>ject  t0 

1  aijxj  +  Vi  =  bn’  1  £  s  "  {5>6’71 

j=l  J  J 

2 

£  *«*)  +  Vi  ‘  b2i’  1  ‘  5’6’7 

xj  S  °»  j  =  1,2,..., 15. 

From  point  B  the  modified  method  takes  us  to  point  C,  with  e  =  4, 

1-12,  i  =  5,  §  *  6^.  It  is  seen  that  point  C  is  an  optimal  solution 
to  the  proximate  problem.  It  can  be  seen  that  point  G  is  an  exact  solution, 
i.e.,  an  optimal  basic  feasible  solution,  to  the  problem 


C1X1  +  C2X2’  subject  to 


aijxj  +  Vi  -  bu»  1  •  3’  4*  8’  12’  13>  14>  15‘ 

This  hull  is  sketched  in  Figure  3. 
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6.  Humeri  cal  Experiments 


In  tnis  section,  we  report  the  outcome  of  comparisons  between  the  modi¬ 
fied  method  and  the  ordinary  method  on  131  problems.  All  runs  were  performed 
on  the  IBM  Model  370/165  Computer.  The  experiments  involved  randomly  gener¬ 
ated  data  with  A  matrices  of  four  sizes:  25  x  25,  100  x  100,  200  x  150, 
and  100  x  200.  Table  I  summarizes  the  input  data,  where  D  is  a  random 
number  between  0  and  1.  In  all  cases  the  objective  function  coefficients 
were  given  by  c  =  15  +  10D.  The  right  hand  side  for  the  ordinary  Simplex 
runs  is  denoted  by  the  vector  b,  and  the  ordinary  runs  are  designated  in 
Table  I  by  e  =  0.  These  runs  were  performed  on  an  in-house  all-in-core  full 
tableau  code  employing  the  usual  maximum  reduced  cost  criterion  for  the  choice 
of  enter  vector.  As  a  validity  check  on  the  in-house  code,  identical  problems 
have  been  run  on  MPS,  the  IBM  linear  programming  package,  with  identical  re¬ 
sults  to  at  least  5  decimal  places.  The  modified  Simplex  algorithm,  as  elab¬ 
orated  in  Section  3,  was  programmed  as  a  special  option  of  the  in-house  code. 

By  the  choice  of  test  problems,  as  seen  in  Table  I,  an  initial  feasible  basis 
of  full  slack  was  available  for  all  runs.  It  was  therefore  necessary  to  con¬ 
sider  only  phase  2  and  all  reported  results  are  based  on  starts  from  the  initial 
full  slack  basis.  The  test  problem  characteristics  were  chosen  in  such  a  way 
at  to  explore  the  effects  of 
(i)  the  size  of  A 


(ii) 

(iii) 

(iv) 


the  dispersion  of  the  a^'s 
the  percentage  of  negative  a^j'! 
the  percentage  of  zeros  in  A. 


In  Table  1,  Pz  denotes  the  percentage  of  zeroes  in  A.  These  were  randomly 
assigned  to  entries  in  A  and  remaining  entries  were  then  drawn  from  the 
appropriate  interval.  For  each  problem  type,  as  defined  by  a  row  of  Table  I, 
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5  randomly  generated  problems  were  run,  with  the  exception  of  the  200  *  150 
case.  For  each  of  these  latter  problems  only  3  random  tests  were  conducted. 
The  results  are  presented  in  Table  II,  where 


It 

mean  computation  time  in  seconds 

MI  - 

mean  number  of  iterations 

R  = 

mean  computation  time  for  modified  Simplex  divided  by  mean 
computation  time  for  ordinary  Simplex. 

ERROR  = 

„  100 !  OBS  -  obm| 

the  mean  value  of  - ' — ^gg  ,  where 

OBS  = 

optimal  objective  value  obtained  with  ordinary 
hand  side  b) 

Simplex 

(right 

OBM  = 

optimal  objective  value  obtained  with  modified 
appropriate  tolerance  about  b). 

Simplex 

(given  the 
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TABLE  I:  TEST  DATA 


Run 

Dim.  of  A 

a.  . 

E 

£ 

Pz(%) 

bl 

b2 

X 

25  x  25 

.01  +  1600D 

23,490 

0 

0 

2 

11 

ii 

23,053 

.15  b 

0 

20,000 

26,511 

3 

it 

23,490 

.31  b 

0 

16,200 

30,780 

4 

100  x  100 

.01  +  500D 

23,490 

0 

0 

_ 

_ 

5 

It 

rt 

23,053 

.15  b 

0 

20,000 

26,511 

6 

1) 

it 

23,490 

.31  b 

0 

16,200 

30,780 

7 

ii 

23,912 

.43  b 

0 

13,630 

34,194 

8 

ii 

23,490 

.80  b 

0 

4,698 

42,282 

9 

100  X  100 

.01  +  500D 

23,490 

0 

25 

_ 

10 

It 

II 

II 

.31  b 

II 

16,200 

30,780 

11 

100  X  100 

1  +  50D 

23,490 

0 

0 

12 

11 

tl 

II 

.31  b 

tr 

16,200 

30,780 

13 

100  x  100 

1  +  SOD 

23,490 

0 

25 

_ 

14 

II 

II 

II 

.31  b 

11 

16,200 

30,780 

15 

100  x  100 

.01  +  2000D 

23,490 

0 

0 

16 

If 

II 

.31  b 

ii 

16,200 

30,780 

17 

tl 

II 

It 

0 

25 

_ 

18 

II 

II 

If 

.31  b 

tl 

16,200 

30,780 

19 

100  X  100 

-125  +  500D 

23,490 

0 

0 

_ 

_ 

20 

II 

fl 

It 

.31  b 

0 

16,200 

30,780 

21 

100  X  100 

-125  +  500D 

23,490 

0 

25 

_ 

22 

II 

11 

11 

.31  b 

it 

16,200 

30,780 

23 

100  X  100 

-250  +  1000D 

23,490 

0 

0 

24 

»» 

II 

It 

.31  b 

H 

16,200 

30,780 

25 

200  X  150 

1  +  598D 

57,971+ 

0 

0 

_ 

14, 49  3D 

26 

ti 

II 

M 

.31  b 

0 

40,000+ 

75,492+ 

10.000D 

18,986D 

27 

100  X  200 

.01  +  500D 

23,490 

0 

0 

_ 

28 

M 

II 

II 

.31  b 

II 

16,200 

30,780 

23 


TABLE  II: 


Run 

£ 

M 

T 

1 

0 

2.5 

2 

.15  b 

2.7 

3 

.31  b 

2.5 

4 

0 

63.2 

5 

.15  b 

41.2 

6 

.31  b 

25.6 

7 

.43  b 

20.3 

8 

.80  b 

15.0 

9 

0 

45.5 

10 

.31  b 

25.4 

11 

0 

59 

12 

.31  b 

19.9 

13 

0 

48.5 

14 

.31  b 

26.8 

15 

0 

59.0 

16 

.31  b 

23.0 

17 

0 

47.7 

18 

.31  b 

23.6 

19 

0 

58.5 

20 

.31  E 

38.5 

21 

0 

48.7 

22 

.31  b 

34.5 

23 

0 

59.6 

24 

.31  E 

39.1 

25 

0 

204 

26 

.31  b 

83.5 

27 

0 

151 

28 

.31  b 

54 

TEST  RESULTS 


HI 

R 

ERROR  (%) 

25 

_ _ 

_ 

18 

1.08 

3.5 

10 

1 

7 

350 

_____ 

149 

.64 

1.9 

57 

.40 

3 

32 

.32 

9 

4.4 

.24 

8.1 

239 

____ 

73 

.55 

4.9 

333 

47 

.33 

4.4 

242 

_ 

___ 

77 

.55 

5.4 

346 

____ 

—  — 

50 

.39 

2.8 

240 

~~~ 

75 

.49 

5.0 

321 

_ _ 

153 

.65 

2.7 

75? 

95 

.64 

5.3 

335 

_ _ 

_ 

152 

.65 

2.8 

394 

J7H 

75 

.40 

2.9 

H  t  \J 

69 

.35 

3.2 
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The  most  meaningful  comparison  between  the  modified  method  and  the  ordinary 
Simplex  method  is  in  terms  of  computation  time.  On  this  basis,  with  respect 
to  a  cstcvis  pai'ibus  analysis,  the  results  in  Table  II  suggest  the  following 
observations : 


1.  Increasing  the  tolerance  appears  to  considerably  increase  the  per¬ 
formance  of  the  modified  method,  without  introducing  great  relative  error  in 
the  optimal  objective  values  (runs  4,  5,  6,  7,  8). 

2.  For  the  small  25  x  25  problems,  up  tc  a  tolerance  of  ±30%,  the 
ordinary  method  was  superior  to  the  modified  method. 

3.  For  all  100  x  100,  200  <  150  and  100  x  200  runs,  the  modified 

method  was  superior. 

4.  For  .100  x  100  matrices,  the  ordinary  Simplex  performance  was  inde¬ 
pendent  of  dispersion  on  the  a^'s  an<*  tlle  percentage  of  negative  aij's 
(runs  4,  11,  15,  19,  23). 

5.  For  positive  matrices  (such  as  runs  6,  11,  15),  the  modified  method 
gave  its  best  performance,  with  a  suggestion  that  tighter  dispersion  on  the 
a^'s  improves  its  efficiency.  There  is  a  strong  suggestion  (runs  20  and  24) 
that  the  presence  of  negative  a^j's  damps  the  efficiency  of  the  modified 
method  and  therefore,  in  view  of  observation  4  above,  decreases  its  advantage 
over  the  ordinary  method.  It  should  be  noted  that  from  the  geometry  of  the 
modified  method  it  might  be  intuitively  expected  to  perform  best  on  a  Bayes 


hull. 


6.  The  addition  of  zeros  to  the  A  matrix  uniformly  improved  the  ordi¬ 
nary  Simplex  performance  (compare  the  Hj,  values  in  4  with  9;  11  with  13;  15 
with  17;  19  with  21). 

7.  The  addition  of  zeros  to  the  A  matrix  does  not  appear  to  influ¬ 
ence  the  efficiency  of  the  modified  method  (compare  the  values  in  6  with 

10;  12  with  14;  16  with  18,  and  20  with  22),  but,  because  of  observation  6 
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above,  the  zeros  diminish  the  advantage  of  the  modified  method  over  the  ordi¬ 
nary  method. 

8.  Runs  21  and  22,  which  in  this  size  problem  give  the  poorest  relative 
advantage  to  the  modified  method,  tend  to  support  observations  5  and  7.  In 
runs  21  and  22,  the  A  matrix  contained  25%  zeros  and  about  18%  negative 
coefficients.  With  the  zeros  enhancing  the  ordinary  Simplex  performance  and 
the  negativities  dulling  the  modified  performance  the  relative  advantage  (the 
R  value)  is  only  .7. 
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Appendi x 

There  are  two  possibly  interesting  special  uses  for  the  modified  method 
which  we  here  briefly  describe. 

1.  Suppose  it  is  desired  to  obtain  a  dual  feasible  tableau  for  the  prob¬ 
lem  max  cTx,  subject  to  Ax  £  b,  x  2  0.  That  is,  we  seek  a  basis  B  such 
that,  setting  “  c  TB  \  we  have  u1 A  >  cT  and  u  £  0.  One  can  obtain 
such  a  basis  B  by  selecting  an  especially  large  tolerance  (the  geometric 
distance  between  the  inner  and  outer  hull  is  the  key  factor)  and  using  the 
modified  method  to  obtain  fast  convergence  to  some  optimal  solution  to  some 
problem  (e.g.,  run  8  in  Tables  I  and  II).  The  final  basis  will  yield  feasible 
dual  variables  and  the  final  tableau  will  be  dual  feasible  for  any  right  hand 
side.  If  it  were  then  desired  to  use  the  dual  method  one  would  begin  with 

the  first  column  given  by  B  ^  G. 

2.  assume  for  convenience  that  all  constraints  are  normalized  and  sup¬ 
pose  it  is  desired  to  obtain  a  near  optimal  solution  to  the  problem  max  c  x, 
subject  to  Ax  <  b^,  x  £  0,  within  a  prespecified  objective  value  accuracy. 

In  particular,  suppose  we  seek  a  feasible  solution,  say  x^,  such  that 

Axq  <  b2,  Xq  £  0,  and  cTXq  ^  c™  s  cTXq  +  a  for  some  specified  value  a, 
where  x  is  a  true  solution  to  max  cTx,  Ax  ^  bji  x  ^  0.  Select  a  large 
tolerance  e  and  let  G  »«  b2  -  e»  b^*b-e.  Use  the  modified  method  to 
obtain  fast  convergence  to  an  optimal  solution  to  some  proximate  problem,  say 
x*,  with  feasible  basis  B*.  If  B*-1b2  £  0,  then  the  basic  components  of 
x  are  given  by  Otherwise,  one  could  proceed  with  the  dual  algorithm, 

possibly  modified  for  inexact  data. 
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